Polynomial Cost Approximations in Markov Decision Theory Based Least Cost Routing
نویسندگان
چکیده
The problem of call admission control and routing in a multi-service circuit-switched loss network can be solved optimally under certain assumptions by the tools of Markov decision theory. However in networks of practical size a number of simplifying approximations are needed to make the solution feasible. Assuming link independence, we propose a new method for approximating the state-dependent link costs accurately and relatively efficiently, even on links with extremely large state spaces. The proposed polynomial approximations are optimal in the sense of minimizing the residual in the continuous-time Howard equations of the Markov decision processes associated with the links. Numerical results are presented, and the proposed approximations are found superior to two earlier link cost approximation methods.
منابع مشابه
Dynamic Programming Based Link Cost Function and Load Estimation Method for ATM Links
In connection-oriented networks dynamic routing schemes are designed to improve the call blocking performance by introducing network intelligence. An accurate model describing a networks statistical behaviour is the network Markov model. Based on this model the theory of dynamic programming for Markov processes (also called the Markov Decision Process theory, MDP) has in the past successfully b...
متن کاملHeuristic methods for delay constrained least cost routing using κ-shortest-paths
The Delay Constrained Least Cost (DCLC) problem is to find the least cost path in a graph while keeping the path delay below a specified value. First formulated in the context of routing in computer networks, the DCLC model also applies to mission planning and other decision problems. DCLC is NP-complete and therefore many heuristic algorithms have been proposed for it. This paper presents two ...
متن کاملA Minimal-Cost Inherent-Feedback Approach for Low-Power MRF-Based Logic Gates
The Markov random field (MRF) theory has been accepted as a highly effective framework for designing noise-tolerant nanometer digital VLSI circuits. In MRF-based design, proper feedback lines are used to control noise and keep the circuits in their valid states. However, this methodology has encountered two major problems that have limited the application of highly noise immune MRF-based circui...
متن کاملApplication of Chaos Theory in Hazardous Material Transportation
Risk factors are generally defined and assigned to road networks, as constant measures in hazmat routing problems. In fact, they may be dynamic variables depending on traffic volume, weather and road condition, and drivers' behavior. In this research work, risk factors are defined as dynamic variables using the concept of chaos theory. The largest Lyapunov exponent is utilized to determine the ...
متن کاملDenumerable Constrained Markov Decision Problems and Finite Approximations Denumerable Constrained Markov Decision Problems and Finite Approximations
The purpose of this paper is two fold. First to establish the Theory of discounted constrained Markov Decision Processes with a countable state and action spaces with general multi-chain structure. Second, to introduce nite approximation methods. We deene the occupation measures and obtain properties of the set of all achievable occupation measures under the diierent admissible policies. We est...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2001